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Abstract 

Based on a recently developed notion of physical realizability for quantum lin- 
ear stochastic systems, we formulate a quantum LQG optimal control problem for 
quantum linear stochastic systems where the controller itself may also be a quantum 
system and the plant output signal can be fully quantum. Such a control scheme is 
often referred to in the quantum control literature as "coherent feedback control." 
It distinguishes the present work from previous works on the quantum LQG prob- 
lem where measurement is performed on the plant and the measurement signals are 
used as input to a fully classical controller with no quantum degrees of freedom. 
The difference in our formulation is the presence of additional non-linear and linear 
constraints on the coefficients of the sought after controller, rendering the problem 
as a type of constrained controller design problem. Due to the presence of these con- 
straints our problem is inherently computationally hard and this also distinguishes 
it in an important way from the standard LQG problem. We propose a numerical 
procedure for solving this problem based on an alternating projections algorithm 
and, as initial demonstration of the feasibility of this approach, we provide fully 
quantum controller design examples in which numerical solutions to the problem 
were successfully obtained. For comparison, we also consider the case of classical 
linear controllers that use direct or indirect measurements, and show that there 
exists a fully quantum linear controller which offers an improvement in performance 
over the classical ones. 

Keywords: Quantum systems; Quantum control; Stochastic control; Linear quadratic 
regulators; Linear control systems 
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1 Introduction 



Recent successes in quantum and nano-technology have provided a great impetus for re- 
search in the area of quantum feedback control systems; e.g. see jU ESI El El EH]- It 
is reasonable to expect that quantum control is an area of research which could play a 
vital role towards realization of conceptual quantum information systems and quantum 
computers which are being extensively studied for potential benefits over their classical 
counterparts. One particular area in which significant theoretical and experimental ad- 
vances have been achieved is quantum optics. In particular, linear quantum optics is one of 
the possible platforms being investigated for future communication systems (see [TB"1 120] ) 
and quantum computers (see [18] and [261 Section 7.5]), besides being an area of indepen- 
dent interest in physics. Interestingly, under appropriate assumptions, the dynamics of 
some quantum optical devices can be approximately modeled by linear quantum stochas- 
tic differential equations driven by quantum Wiener processes; see [10J. For details on 
quantum stochastic differential equations and Wiener processes, see [15] 1301 IS]. 

In general, quantum linear stochastic systems represented by linear Quantum Stochas- 
tic Differential Equations (QSDEs) with arbitrary constant coefficients need not corre- 
spond to physically meaningful systems. This is the same as for classical stochastic 
differential equations (throughout this paper we shall use the term "classical" to loosely 
refer to systems that have no quantum mechanical components). However, because clas- 
sical linear stochastic systems can be implemented at least approximately, using analog or 
digital electronics, we regard them as always being realizable. Physical quantum systems 
must satisfy some additional constraints that restrict the allowable values for the system 
matrices defining the QSDEs. In particular, the laws of quantum mechanics dictate that 
closed quantum systems evolve unitarily, implying that (in the Heisenberg picture) cer- 
tain canonical observables satisfy the so-called canonical commutation relations (CCR) at 
all times. Therefore, to characterize physically meaningful systems, [32] has introduced 
a formal notion of physically realizable quantum linear stochastic systems and derives a 
pair of necessary and sufficient characterizations for such systems in terms of constraints 
on their system matrices. 

In this work, we build on the ideas in [T7] and [32] arid formulate a quantum LQG 
optimal control problem for quantum linear stochastic systems. The distinguishing fea- 
ture of our work compared to previous treatments of the quantum LQG problem in the 
literature is that we allow the controller to be another quantum system whereas previous 
works only consider the case where the controller is a classical system driven by the re- 
sult of continuous measurements performed on the output of the quantum plant. In the 
physics literature, (feedback) control using a fully quantum system is often referred to 
as "coherent feedback control" to distinguish it from control using a classical controller. 
Coherent controllers are of interest for, among other things, their potential for providing 
faster speed of processing/higher bandwidth (by dispensing of the use of "slow" electron- 
ics) and better performance (as will be demonstrated later in this paper). We stress that 
the coherent LQG controller design considered herein leads to a more difficult problem 
which cannot be solved using the usual approach of quantum conditioning and dynamic 
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programming. By viewing the problem as a polynomial matrix programming problem, 
we show that by utilizing a non-linear change of variables due to [31], the problem can 
be systematically converted to a rank constrained LMI problem. To demonstrate the 
feasibility of numerically solving this problem, we provide a design example of stabiliza- 
tion of a quantum plant for which a solution to the rank constrained LMI problem was 
successfully obtained using an alternating projections algorithm due to [29|. 

The organization of the paper is as follows. We begin in Section [2] with an overview 
of quantum linear stochastic systems that are of interest in quantum optics. Section [3] 
then recalls some key definitions and results from [T7] on physically realizable systems. 
In Section |4| we formulate a novel quantum LQG problem that allows the controller 
to be another quantum system. A numerical procedure for solving the quantum LQG 
problem is then proposed in Sections [5] and [6j In Section [7j we discuss an extension of 
the methodology developed in the preceding two sections. In Section |8j we consider the 
design of a fully quantum LQG controller for stabilizing a marginally stable quantum 
plant and show that there exists a fully quantum controller which offers an improved 
level of performance over a fully classical linear controller which uses direct or indirect 
measurements. Finally, in Section [9] we offer some concluding remarks. 



2 General quantum linear stochastic models in quan- 
tum optics 

We follow the quantum probabilistic setup of [T71 Section II] and recall the notion of 
physical realizability introduced therein. To this end, consider linear non-commutative 
stochastic systems of the form 

dx{t) = Ax(t)dt + Bdw(t); x(0) = x 

dy(t) = Cx(t)dt + Ddw(t) (1) 

where A, B, C and D are real matrices in R nxn , ]R nxn ™ ; w iyXn and M. n y xn ™ respectively. 
Also, (n,n w ,n y are positive integers), and x{t) = [ xi(t) ... x n (t) ] T is a vector of 
self-adjoint possibly non-commutative system variables. 

The initial system variables x(0) = Xq are Gaussian with state and satisfy the 
commutation relation^ 

[x j (0),x k (0)] = 2iQ jk , j,k = l,...,n, (2) 

where is a real antisymmetric matrix with components Qjk, and i = y/—l. Here, the 
commutator is defined by [A, B] = AB — BA. To simplify matters and without loss of 
generality, we take the matrix to be of one of the following forms: 

1 That is, Tr(pe lA x °) = e lA m_ 3 A GA for all A e R n where m S R" and G is a real symmetric matrix 
satisfying G + i<d > with as given in the text above; see, e.g., j22j [lOj [30]). 

2 In the case of a single degree of freedom quantum particle, x — {x\, X2) T where X\ = q is the position 
operator, and x 2 — p is the momentum operator. The annihilation operator is a = (q + ip)/2. The 
commutation relations are [a, a*] = 1, or [q,p] = 2i. 
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• Canonical if G = diag(J, J, . . . , J), or 

• Degenerate canonical if O = diag(O n / X n', J,...,J), where < n' < n. 
Here, J denotes the real skew-symmetric 2x2 matrix 



J 



1 
-1 



and the "diag" notation indicates a block diagonal matrix assembled from the given 
entries. To illustrate, the case of a system with one classical variable and two conjugate 
quantum variables is characterized by G = diag(0, J), which is degenerate canonical. The 
vector quantity w describes the input signals and is assumed to admit the decomposition 

dw{t) = p w (t)dt + dw{t) (3) 

where w(t) is the noise part of w(t) and (3 w {t) is a self adjoint, adapted process (see 
[T5J [301 E] for a discussion of adapted quantum processes). The process j3 w {t) serves to 
represent variables of other systems that may be passed to the system ([I]) via a connection. 
It is also represented on the same quantum probability space, which can be enlarged if 
necessary. Consequently, we assume that components of /3 w (t) commute with those of 
dw(t). Furthermore, we will also assume that components of /3 w (t) commute with those 
of x(t); this will simplify matters for the present work. The noise w(t) is a vector of 
self-adjoint quantum noises with Ito table 

dw{t)dw T {t) = F&dt, (4) 

where F$ is a non-negative Hermitian matrix; e.g., see [301 E]- This determines the 
following commutation relations for the noise components: 

[dw(t), dw T {t)} = dw{t)dw T {t) - (dw(t)dw T (t)) T = IT^dt, (5) 

where we use the notation Sw = ^(F^, + F$), = — F!~) so that = S& + T^. 
For instance, F^ = diag(l, / + i J) describes a noise vector with one classical component 
and a pair of conjugate quantum noises. (Here I is the 2x2 identity matrix.) The noise 
processes can be represented as operators on Fock spaces; e.g., see [3D] . 

For simplicity, we also adopt the conventions of [17J to put the system ([T]) into a 
standard form. Therefore, we assume that in Q: (i) n y is even, and (ii) n w > n y . 
Furthermore, we also assume that F^ is of the canonical form F^ = I + idiag(J, . . . , J). 
Hence n w has to be even. Note that if F^, is not canonical but of the form F^, = I + 
idiag(0 n / xn /, diag( J, . . . , J)) with n' > 1, we may enlarge w(t) (and hence also w(t)) and 
B as before such that the enlarged noise vector, say w', can be taken to have an Ito matrix 
Fm which is canonical. 
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3 Physical realizability of linear QSDEs 



A linear quantum stochastic system ([!]) with arbitrary system matrices need not represent 
any meaningful physical system. For example, quantum mechanics dictates that closed 
physical quantum systems evolve in a unitary manner which (in the Heisenberg or in- 
teraction picture) implies the preservation the canonical commutation relations (CCR): 
x{t)x{t) T — (x(t)x(t) T ) T = 2iO for all t > 0. This essentially restricts the allowable coef- 
ficients A, B, C, D for a physically realizable quantum linear stochastic system. For this 
reason, [T7| develops a precise notion of physical realizability based around the concept 
of an open quantum harmonic oscillator [TT1 Section 2] as the basic "dynamical unit" 
of a physically realizable quantum system. Such an oscillator is completely described by 
a quadratic Hamiltonian H = ^x(0) T Rx(0), where R is a real symmetric matrix, and a 
linear coupling operator L = Ax(0), where A is a complex matrix (here we correct a minor 
error in [T71 Definition 3.1] where the | factor had been omitted from the definition of 
H). We now give a brief summary of the main ideas developed in [TT] . 

In the case that the system is fully quantum (i.e. is canonical) then is said to 
be physically realizable if it represents the dynamics of some open quantum harmonic 
oscillator [T71 Section III- A]. If is not canonical then a classical component of x(t), say 
Xi(t), is viewed as one component of a pair of (fictitious) canonically conjugate operators 
(xi(t), Zi(t)) satisfying [xi(t), Zi(t)] = 2i and which commute with all other components of 
x(t). In that case ([!]) is said to be physically realizable if it can be embedded in some larger 
system also of the form (fi]) with a special structure (referred to as an augmentation of ([TJ in 
[T?] Section III-B]) which is itself physically realizable, i.e. the larger system represents the 
dynamics of an open quantum harmonic oscillator. Based on this definition, [TT] derives 
a pair of necessary and sufficient conditions for a quantum linear stochastic system of the 
form Q to be physically realizable in terms of the system matrices, regardless of whether 
is canonical or degenerate canonical. It is as follows, with N y = n y /2, N w = n w /2 and 
using the notation diag m (i^) to denote a block diagonal matrix with a square matrix K 
appearing m times on its diagonal blocks: 

Theorem 1 ( |17| ) The system |7]) is physically realizable if and only if: 

iAQ + i&A T + BT W B T = 0, (6) 



B 



0(ntu— n y )xi 



0C J dia gjv fJ), (7) 



and D = [ I nyX n y Qn y x(n w ~n y ) ]■ Moreover for canonical 0, the corresponding Hamilto- 
nian and coupling matrices have explicit expressions as follows. The Hamiltonian matrix 
R is uniquely given by R = |(— OA + A T Q), and the coupling matrix A is given uniquely 
by 

A = ~h [ NwXNu I NwXNw ] (T- 1 fB T Q, (8) 
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where Y = P/v^diag^ (M) with M 



and Pn w is a permutation matrix acting 



1 i 
1 -i j 

as P Nw {a 1 ,a 2 , . . . ,a 2Nw ) T = (a u a 3 , . . . , a 2Nw -i, a 2 , a A , . . . , a 2Nw ) T . In the case that 6 is 
degenerate canonical, a physically realizable augmentation of the system can be constructed 
to determine the Hamiltonian and coupling operators using the explicit formulas above. 



Note that background information concerning the Hamiltonian and coupling matrices 
in quantum systems can be found in references [9j [TUl [T7] . 



4 Formulation of the quantum LQG problem 

We consider plants described by non-commutative stochastic models of the following form: 

dx(t) = Ax(t)dt + Bdu{t) + B w dw(t); x(0) = x; 
dy{t) = Cx(t)dt + D w dw(t); 
z{t) = C z x{t) + D z (3 u {t). (9) 

Here x{t) is a vector of plant variables, w{t) is a quantum Wiener disturbance vector, (3 u {t) 
is an adapted, self-adjoint process commuting with x{t) (i.e. (3 u {t)x{t) T — {x{t)f3 u {t) T ) T = 
0), and u(t) is a control input of the form 

du{t) = (3 u (t)dt + du{t) (10) 

where (3 u {t) is the "signal part" and u{t) is the noise part of u{t). The vectors w(t) and 
u(t) are independent quantum noises (meaning that they live on distinct Fock spaces) 
with Ito matrices F w and Fa that are all non-negative Hermitian. We also assume that 
x(0)x(0) T -(x(0)x(0) T ) T = 6. 

Controllers are assumed to be non-commutative stochastic systems of the form 

d£(t) = A K £(t)dt + B K1 dw K1 (t) + B K2 dw K2 (t) + B K3 dy(t); 

du{t) = C K £(t)dt + dw K1 (t) (11) 

where = [ £i(£) . . . £n K (t) } T is a vector of self-adjoint controller variables of the 
same dimension as x(t) (i.e. the controller is of the same order as the plant), Bk2 is a 
square matrix of the same dimension as Ak, and Bki has the same number of columns as 
there are rows of Ck- The noises WKi(t), i — 1, 2, are vectors of non-commutative Wiener 
processes (in vacuum states) with non-zero Ito products and which are independent of 
w(t). We assume that £(0)£(0) T - (£(0)£(0) T ) T = Q K . Here Q K is the skew-symmetric 
commutation matrix for the controller variables £ that could be of a canonical or degen- 
erate canonical form (cf. Section |2|. 

Assume further that x(0)£(0) T — (£(0)x(0) T ) T = 0, i.e. the plant and controller are 
initially decoupled. The closed loop system is obtained by the identification (3 u (t) = 
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Cx^{t) and u(t) = WKi(t), and interconnecting ^ and (11) to give 



where i](t) 



dr)(t) 
z{t) 



An(t)dt + Bdwd(t); 
C V (t) 



;i2) 



W c l(t) 



B 



w{t) 

W K1 (t) 
W K 2(t) 

B w 

Bk^D w 



A 



A BC K 
BkzC A k 



B 2X 2 
Bri Bk2 



C=[C Z D Z C K } . 



With (12) we associate a quadratic performance index 



J(t f ) 



(z 1 (t)z(t)) dt. 



(13) 



Here the notation (•) is standard and refers to quantum expectation (e.g., see [24J). In 
this case, the quantum expectation is on the composite system (plant, controller and all 
quantum noises) following [IT] . 

We shall proceed to derive an explicit expression for this performance index; see also 
To this end, define the symmetrized covariance matrix P(t) by 



(14) 



Using the quantum Ito rule, we have 

dP[t) : 



: l((d V (t) rj T {t)) + ((drj(t) V T (t)V) + (r,(t) d V T (t)) + 
(( V (t) d^im + (BF Wc[ B T + (BF Wc[ B T ) T ) dt) 

= (AP(t) + P(t)A T + \B{F Wcl + Fl t )B T ) dt, 

= (AP(t) + P(t)A T + BB T ) dt, 

where the last equality follows from our convention that all noises are canonical (hence 
\{F Wcl + Fw J = Hence P(-) satisfies the differential equation 

P(t) = AP(t) + P(t)A T + BB T ; P(0) = P . (15) 
We now have, using the symmetry of C T C and P, that 

( z t z ) = ( V T C T C V ) 

= (Tr(ri T C T C7i)} 

= i(Tr(C T C[ W T + ( W T ) T ])) 

= Tr (C T CP). 



Hence, the performance index ( 13 ) can be expressed as 



J(t f ) = / Tr(C T CP(t)) dt (16) 
Jo 



where P{t) solves (15). We will focus our attention on the infinite horizon case where we 
allow tf | oo. Assuming that A is asymptotically stable, standard results on Lyapunov 
equations give us lim^oo P(t) = P, where P is the unique symmetric positive definite 
solution of the Lyapunov equation: 

AP + PA T + BB T = 0. (17) 

Furthermore, by standard methods of analysis we have 

limsup - / ' {z T (t)z{t))dt = Tr{C T CP) = Tr(CPC T ). 

As before, let diag m (J) denote a block diagonal 2m x 2m matrix with m J matrices 
on the diagonal blocks and let denote the dimension of wk% for i = 1, 2, 3. We may 
now formulate our quantum LQG control problem for an infinite horizon as follows: 

Problem 2 (Quantum LQG synthesis) Given a fixed choice of Qk, find controller 
matrices Ax, P>k\, Bk2, Bk3 and Ck that minimizes the cost functional Joo = Tr(CPC T ) 



subject to the constraint that the controller (11) is physically realizable. That is, A K , 
B>ki, B>K2, B>K3, Ck satisfy the conditions of Theorem\l\with the identification: A = Ak, 
B = [ B K1 B K2 B K3 ], C = C K , D = [ I nu xn u ], and w = [ w T Kl w T K2 y T } T , 
leading to the pair of constraints: 

A K Q K + Q K A K + B Kl diag ni/2 (J) B T Kl + B K2 diag n2/2 ( J) B T K2 + 

B Jf3 diag n3/2 (J)^3 = 0; (18) 
B K i = Q K C T K dmg nu/2 (J). (19) 

In the above problem 9^ is a fixed but freely specified parameter that determines 
the type of controller sought. For example, if is canonical then the controller will 
be fully quantum. Our formulation of the quantum LQG problem differs from previous 
formulations of the quantum LQG problem, such as given in [9] and [8j. The important 
difference is that in the earlier works, the controller is classical whereas in our formulation 
we seek a controller which may possibly be another quantum system (depending on how 
0^: is defined) which generates an optical field to drive the quantum plant. What is new 



in the formulation are the additional constraints (18) and (19) that must also be satisfied 



by the controller to be physically realizable. This is natural since for real applications, 



the controller should represent a physical system. The constraint (18) is a non-convex, 
non-linear equality constraint on the controller matrices Ak-, Bki, Bk2, Bk3 and Ck that 
presents a formidable challenge in the controller design. 
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At present we do not know if there exists an exact or analytical solution to Problem 
[2] Moreover, in our experience this non-convex problem is difficult to solve numerically 
using a general purpose optimizer such as the 'fmincon' routine in the Matlab Optimiza- 
tion Toolbox; see [31]. In our investigation, it has been more fruitful to consider the 
relaxed problem of finding a controller that achieves the cost bound < 7 for some 
pre-specified bound 7 > 0, and to reformulate this problem into a rank constrained LMI 
feasibility problem. As in if 00 synthesis, a solution to Problem [2] can, in principle, be 
found iteratively by employing a bisection method, or a variant thereof, on the bound 7. 
Therefore, we focus our attention instead on the following problem: 



Problem 3 Given a fixed choice of Ok ^nd cost bound parameter 7 > 0, find controller 
matrices Ak, Bki, Bk2, Bk3 o^nd Ck such that the following conditions hold. 

Fl. There exists a symmetric matrix P > satisfying |7 
F2. Joo = Ti{CPC T ) < 7. 



F3. The physical realizability constraints (18) and (19) are satisfied. 



5 Reformulation of the quantum LQG problem into 
a rank constrained LMI problem 

We shall now discuss how to transform Problem [3] into a rank constrained LMI problem 
which is amenable to numerical methods. To best illustrate the idea, we opt to restrict 
our attention to the case where Ok is canonical. Moreover, to facilitate easy and explicit 
exposition of the matrix lifting and linearization technique, we shall take for a "canonical" 
example, a plant and controller of order n (recall that in our setup we are looking for a 
controller which is of the same order as the plant) with n y = n u = n and Bki, Bk2, Bk3, 
Ck all of dimension n x n. Nonetheless, the matrix lifting principle described for this 
canonical case can in principle be adapted to more general scenarios and for the case in 
which @k is degenerate canonical, that is, the case where the controller has both quantum 
and classical degrees of freedom. However, the lifting is not necessarily unique and is too 
complicated to describe in a general form. More importantly, for efficiency the choice 
of suitable lifting variables should in any case be considered on a case by case basis to 
exploit any existing structure in a particular problem. 

Consider a n-th order plant ^ with and a n-th order controller (Jill) 



with n WK1 = n WK2 = n (hence Bk\-,Bki G M nxri ). Then P will be a symmetric matrix 



of dimension 2n x 2n. The first step is to transform the constraints (17) and Joo < 7 
into an LMI constraint. To do this we exploit a non-linear change of variables given in 
[3~H Eq.(35)], but to do this we first need to suitably redefine our plant and controller 



equations while leaving the closed-loop equations unaltered. To this end, let us redefine 
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our plant as: 



dx(t) = Ax(t)dt + Bf3 u {t) + B' w ,dw'(t); x(0) 
dy'(t) = C'x{t)dt + D' w ,dw'(t); 



with w' 



w 



z(t) = C z x(t) + D z p u (t), 




n„T „„T IT R/ 

W K1 W K2 I , B w> 


= [ B w 


B nX n ]j C 


— [ nX n nX n 




Onxn m 


Inxn O n xn 




K> = 




Onxriu, Inxn 






D w 


Onxn Onxn 





(20) 
C T ] T and 



Here y' is the output equation for the modified plant that now includes the quantum noise 
Wk2 that enters in the controller, but not in the original plant. In this way all noises can 
now be thought of as coming from the modified plant, as in the setup of standard classical 
LQG problems. Then, we also redefine our controller equations as: 



d£(t) = A K Z{t)dt + B K dy'{t); 
Pu(t) = C K t{t), 



(21) 



with B K = [ Bki Bk2 Bk3 ]■ It is easily seen that interconnecting (20) and (21) gives 



the closed-loop equation (12). Now we are in the setup of [31] with D K = in \S1\ Eq.(2)]. 

We now follow [21] by introducing auxiliary variables N, M, X, Y, Q G M nxri , with 
X, Y, Q symmetric, and applying the following non-linear change of variables (see [211 
Section IV-B] with D = D K = 0): 



A 
B 

C 



NA K M T + NB K C'X + YBC K M T + YAX; 

NB K - 

C K M T . 



(22) 
(23) 
(24) 



Then, the constraints (17) and Joo < 7 can be rewritten as the LMI constraint [311 
Eq.(14)]: 

" AX. + XA T + BC + (BC) T A T + A 

A + A T A T Y + YA + BC + (BC'f 

(B' W ,) T (YB' wl + BD' wl f 

B[ n , 

< 0: 



YB' W , + BD' W , 



X / (C 2 X + D Z C) T 

I Y CJ 

C Z X + D Z C C z Q 

Tr(Q) < 7 . 



> 0; 



(25) 

(26) 
(27) 
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Since the controller is of the same order as the plant, the matrices N and M can be freely 
chosen to be any pair of (invertible) square matrices satisfying MN T = I — XY. 



Once matrices A, B, C, X, Y, Q satisfying the LMIs (25 )-(27) and matrices N and M 



satisfying the conditions of the last paragraph have been found, the original controller 
matrices A K , B k ,Ck can be reconstructed as [31, Eq.(40)]: 



C K 

B K 
A 



K 



CM~ T ; 
iV -1 B; 

AT 1 (A - NB K C'X - YBC K M T - YAX)M~ 



(28) 
(29) 
(30) 



Multiplying the left and right hand sides of (18) with N and N T , respectively, and 
introducing new variables N = NQk (keep in mind here that is a fixed matrix), 
Ak = NAk and Bki = NBxi, i = 1, 2, 3, (18) and (19) can be expressed as: 



(— AM~ T + (B K3 C + YA)XM" T + YBC K )N T 
+N(AM~ T - (B K3 C + Y A)~KM~ T - YBC K ) T + 

3 

^Ki diag„ /2 ( J) B T Ki = 0; 



i=l 



B Kl = NC T K dmg n/2 {J). 



(31) 
(32) 



Conversely, if A K , B K i, B K2 , B K3 , Ck solve Problem 3 and P is the solution of (17), then 



the LMIs (25)-(27) are all satisfied for some pair of square matrices M and iV satisfying 
MN T = I — XY; see [311 Section IV-B]. Furthermore, since the solution is physically 



realizable, (31) and (32) are also satisfied. We summarize the preceding discussion in the 



following theorem: 



Theorem 4 Under the assumptions of this section, Problem^ has a solution for a given 
7 > if and only if there exist matrices A, Bki, Bk2, Bk3, C, X ; Y ; N, M, N, 
Ck satisfying the LMIs (25)- (27) (with B = [Bki Bk2 &K3 }) an d the constraints 
(&H , N = NQ K , NM t = I - YX and C = C K M T . 



Note that (31) and (32) are polynomial matrix equality constraints in the parameters 
(A, B K i, Bk2, Bk3, C, X, Y, N, M~ T ). By this we mean that they are equality constraints 
in a matrix-valued multivariate polynomial with matrix-valued variables. If we take as 
decision variables the elements of the parameters (for symmetric variables such as X we 
need only take the upper triangular elements) then this becomes a collection of scalar mul- 
tivariate polynomial equalities. It is well known that by introducing additional variables, 
called lifting variables, and some auxiliary equality constraints, general polynomial equal- 
ity and inequality constraints can be "linearized" and transformed into linear equality 
and inequality constraints in some symmetric positive semidefinite matrix X, plus a rank 
one constraint: rank(X) = 1 [251 [7]. However, converting polynomial matrix constraints 
into a collection of scalar polynomial constraints may not be desirable as the resulting 
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scalar polynomials could be of orders much higher than the order of the original matrix 
polynomial. Subsequently, when there are many decision variables the resulting scalar 
polynomial program may easily become too large to handle numerically. This is true in 



our present case, if we are to scalarize (31) then we would end up with 34 decision vari- 
ables and constraints in polynomials of order 4, a substantially large problem. Therefore 
we would like to keep the matrix structure of our problem and try to find suitable matrix 
lifting variables instead. The idea is similar to the scalar version, but we need to take care 
of the fact that, unlike scalars, matrices do not in general commute with one another. 



We now proceed to linearize (31) and (32) by introducing appropriate matrix lifting 



variables and the associated equality constraints, and transforming them into an LMI with 
a rank n constraint. However, in what will follow we set M = I nxn and N = 1-YX; this 
removes one free matrix variable, namely M~ T , and reduces the complexity of the problem. 
The 14 matrix lifting variables Wi, W 2 , ■ . . , Wu G R nxn are as follows: Wi = BkJ 
i = 1, 2, 3, W 4 = YB, W 5 = B K3 C+YA, W 6 = iVC T , W 7 



W 10 = W 4 W[, W n = W 5 WJ, W 12 = W 1 B* 1 , W 13 



'6 " 

rr 



rnxn are ag f U 0WS - yy. 

- NX, W 8 = AiV T , 
and Wu 



Ki" i 

, r, 9 — YX, 

W 3 B% 3 . Now, 



let Z be a 23n x 23n symmetric matrix, 

Zjj = lZkl]k=in+l,(i+l)n,l=jn+l,(j+l)n, 
X = (Xt, . . 

and 



X = (Xi, ...,x 8 


) = 


= (1,2, 


...,8), 




V = Oi, . . .,v 14 ) 




(9, 10, 


...,22). 




' satisfy the constraints: 










Z > 




Z„ 6 ,l 




= 


Z(),0 — Inxn — 




Zt) 7 ,l 




= 


Zl,^ — Za, 6j i = 




Z V8 ,i 


~ Z XljXg 


= 


Zl,a; 7 — Z l7> i = 




Z«9,l 


Zxf,XQ 


= 


Z Vljl - Z a;2i idiag n/2 (J) = 





Zl)io,l 


Zu4,lig 


= 


Z„ 2i i — Z X3 ,i diag n / 2 (J) = 





Z„ n ,i 




= 


Z„ 3 ,i - Z X4il diag n/2 (J) = 





Zl)12,l 


z - l Vl,X2 


= 


Z« 4l i — Z XTil B = 




z i> 13 ,i 


z - i v 2 ,x 3 


= 


Z« 5 ,i — Z X4t iC — Z X7t \A = 





Zi;i4,l 


~ Z V3l X 4 


= 



•hi 



J Vg, 



(33) 



Here, terms of the form Z a ^ with a,b G {xi, . . . , x$} U {v i, . . . , v 14} should be identified 



with Z a) i(Z^i) T . The LMI constraints (25)-(27) can be expressed in terms of Z by re- 
placing A, B, C, X, Y respectively with 

Z xil , [ Z X2i i Z X3) i Z x . 4j i ] ,X XS} i,Z X6i x,X XTi i, while the physical realizability constraints 



(31) and (32) become the following pair of linear equality constraints: 



— Z„ 8 ,i + Z^ gjl + Z Vlu i - z^ Ujl + Z 

+Z Vl2 ,i + Z„ 13( i + Z 
Z X2 ,i — Z ?J6)1 diag n ; 2 (J) 



7 T 

^vio,l 



= 0. 



0: 



(34) 
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Finally, we also require that Z satisfy a rank n constraint: 



rank(Z) < n. 



(35) 



To understand the above rank constrained LMI and its relation to our original con- 



straints, suppose that there is a Z satisfying (33)-(35) and the LMI constraints (expressed 
in terms of block elements of Z). Then, since Z > and is of rank at most n, we may 



factorize it as Z = VV T , where V G 



i)23nxn 



and satisfies [Vj 



;/ji,j=i,n — Inxnj and by 



(33) we recover A, Bk% 
recover Wi = Z„, i, i = 



1, 2, 3), C, X, Y, N respectively as Z Xu i, . . . , 7i XSil , and also 
.,14. Then N = NO^ 1 and B Ki = N~ l B Ki (i = 1,2,3). 



The controller matrices Ak, Bk, Ck are given by (28)-(30) and by construction they will 
satisfy (25)-(27), (18) and (19). Thus, we obtain a solution to Problem [3] 

It should be noted that due to the simplifying assumptions M = I and N = I — YX, 
solvability of the rank constrained LMI problem formulated above is only sufficient for 
solvability of Problem [3j In fact, in Theorem [4] it is only required that M and N satisfy 
NM T = I - YX. Nonetheless, it is not difficult to see that by (i) introducing additional 
variables M, N, C K = CM~ T , A = AM~ T , X = XM" T , (ii) additional lifting variables 
Wis = NM T } W 16 = AM T , Wvr = XM T , W 18 = C K M T and associated constraints 
W 15 - I + W 9 = 0, A - W 1K = 0, X - W l7 = 0, N - NQ K = 0, C - W 1S = (iii) 
redefining We = NC K , Wj = iVX T and W$ = AN T , and (iv) enlarging and redefining Z 



as well as the set of constraints (33) and (34) accordingly, these simplifying assumptions 



can be removed to make the resulting rank constrained LMI problem also necessary for 
solvability of Problem [3j but at the expense of having to solve a larger problem. The 
simplification we have proposed here, however, may be especially useful for reducing the 
complexity of problems with a plant dimension larger than 2. We conclude this section 
with the following remark. 



Remark 5 In the formulation of this section, it is not actually essential to fix Ok to 
be diag n / 2 (J). Instead, it may also be fixed to be Q K = *Scfiag n / 2 (</)S' T for any real 

a 



invertible matrix S. Indeed, if A K , B Ki 



then A K = S^AlS, B 



>Ki 



s 



D Kii 



1,2,3), C S K solves ProblemQfor Q K 
1,2,3), C K = C S K S solves Problem^ f 



or 



Qk — diag n / 2 ( J); for details, see a related discussion in Section^where Qk is allowed to 
be a free variable. This added flexibility will be valuable for numerical attempts at solving 
Problem® 



6 Numerical solution of the rank constrained LMI 
problem 

We have seen in the preceding section that our problem is essentially a polynomial matrix 
programming (to be precise, feasibility) problem (since LMIs can themselves be viewed as 
polynomial matrix inequalities) and that the latter can be converted to a rank constrained 
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problem. It is well-known that many important practical control problems can be for- 
mulated as polynomial programming problems, including reduced order robust controller 
design, static output feedback and gain scheduling (see [T3] and the references therein). 
They are non-convex and non-linear problems that are, in general, difficult to solve. In 
fact, some of these problems are known to be NP-hard [33j EI]- 

If one tries to directly attack the (scalar or matrix) polynomial programming problem, 
then a specialized method for solving them is to employ LMI relaxations techniques based 
on the theory of moments and the dual theory of sum of squares (SOS) polynomials; see 
[2"T| Uni HH H3] • Under appropriate conditions, relaxation methods can be guaranteed to 
converge as the order of relaxation is increased and it can be checked whether a global 
optima may have been obtained at a particular relaxation. Despite its attractive features, 
the size of the relaxed LMI problem grows very quickly with the number of decision 
variables, the degree of polynomials involved and the order of relaxation, making the 
method impractical for problems with many decision variables. 

On the other hand, if the problem is converted to a rank constrained LMI problem then 
there are iterative algorithms in the literature that try to directly search for a feasible point 
satisfying the set of LMIs and the rank constraint, mostly based on the idea of alternating 
projections (see [29J and the references therein). The main drawback of these algorithms 
is that they are difficult to analyze and are not in general guaranteed to converge from 
arbitrary starting points, even if a solution exists. However, since there are no relaxations 
involved that increase the size of the problem to be solved, they can be more attractive 
for solving medium and larger size polynomial programming problems. This makes them 
more suitable for our current problem, which can be considered to be of a substantial 
size (recall that if it is converted to a scalar polynomial programming problem then there 
would be 34 decision variables and involve multivariate polynomials of up to degree 4). 

To solve the rank constrained LMI problem formulated in the last section, we shall use 
an algorithm by [2H] that has been implemented in the freely available Matlab toolbox 
LMIRank (see [28]) and can be called via the Yalmip optimization prototyping environ- 
ment; see [23]. This algorithm is also based on alternating projections but, unlike previous 
alternating projections algorithms, has a built-in Newton step that has the potential to 
accelerate convergence. In Section [8j we will use this method to numerically solve an 
example coherent LQG control problem. 

As mentioned earlier, solvers for rank constrained LMI problems are not guaranteed 
to converge from arbitrary starting points. Therefore, it is important to have a heuristic 
method for choosing starting points for these algorithms. For a given 7 > 0, to obtain 



a starting point for the LMIRank solver we suggest to first solve the LMIs (25)- (27) to 
obtain A, B, C, X, Y, Q. Then set M = I nxn and N = I — YX and compute B KX , B K2 , 
Bk3, N and the matrix lifting variables W\, . . . , according to the definitions given in 
Section |5] Let 



V = [I nxn A T B T Kl B T K2 B T K3 C T X T Y T N T W? ... W, 
Then we set Z = VqV7 clS db heuristic starting point. 



T ]T 
14 J • 



14 



7 An extension of the numerical procedure 



In this section, we discuss an important extension of the methodology that has been 
developed in preceding sections of the paper. 

In Problem [3j the commutation matrix Ok is a fixed but freely specified parameter 
that determines the type of controller sought. However, since Ak, Bk, Ck are all allowed 
to be free, it is not essential to restrict Ok to be canonical or degenerate canonical. A 
similarity transformation on Ak essentially corresponds to a (matrix rescaling) of 0^ 
(i.e. pre and post-multiplication by a non-singular matrix). Therefore it is possible to 
also allow Ok to be a free variable that is only restricted to be real and skew symmetric. In 
this setting, we do not a priori determine the type of controller that is sought (a classical, 
quantum, or mixed classical-quantum controller). Instead, we also seek an optimal type 
of controller. This leads to a modification of Problem |3] where the former restriction on 
Ok is removed. 



Problem 6 Given a cost bound parameter 7 > ; find real matrices A K , B K \, B K 2, B K 3, 
Ck and a skew symmetric real matrix Ok such that: 



1. There exists a symmetric matrix P > satisfying (11). 

2. Joo = Ti(CPC T ) < 7. 

3. The resulting controller is physically realizable. That is, Ak, Bki, Bk2, Bkz, Ck 



and Ok satisfy (IS) and (19) 



The following lemma is then immediate and shows that solving Problem [6] also solves 
Problem |U 



Lemma 7 Suppose that the matrices Ak, Bki, Bk2, Bkz, Ck and Ok solve Problem 
[fil and Ok = SZS T for some canonical or degenerate canonical matrix Z and some real 
invertible matrix S. Then the matrices 

Ak = S~ 1 A K S; B K i = S~ l B K i i — 1,2,3; C K = C K S, (36) 

solve Problem^ for Ok = Z . 

Proof. Since is real skew symmetric, we can find an invertible matrix S such that 
Ok = SZS T for some matrix Z which is either canonical or degenerate canonical. Now, 
we have that 



A K K + K A T K + B K i diag ni/2 (J) B T K1 + B K2 diag„ 2/2 ( J) B K2 + 

B K3 dmg n3/2 {J) B K3 = 0; 
B K i = K C K diag nu/2 (J). 



(37) 
(38) 
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After substitution of (|36|) and 6^ = SZS T into (|37|) and (|38|) and some algebraic manip 



ulations, it is easily obtained that A K , B K and Ck satisfy 

A K Z + ZA T K + B K1 diag ni/2 ( J) B T Kl + B K2 diag 



n 2 /2 



(■/) B T K2 + 



B K3 diag ns/2 (J) B K3 = 0; 



(39) 
(40) 



= ZC x diag nu//2l 

Moreover, the LQG cost is invariant under a similarity transformation of the controller 
state space matrices. Hence, these matrices solve Problem [3] with Ok = Z, as claimed. 
□ 

The following corollary is then obvious. 
Corollary 8 Let ®k be given (canonical or degenerate canonical) and suppose that Ak, 



B KX , B K2 , B K3 , Ck solve the standard LQG problem for a given 7 > (i.e. (17) and 
J 00 < 7 ore satisfied), and there exists a real skew symmetric Z satisfying (39) and (46). 
Moreover, suppose there exists a real invertible matrix S such that SZS T = 0#. Then 
the matrices Ak, Bki, Bk2, Bk3, Ck given by: 



A K = SAkS- 1 ; 
solve Problem^ 



B 



Ki 



SB 



Ki 



1, 2, 3; Ck — CkS 1 



(41) 



The preceding corollary says that a solution A K , B K , Ck to the standard LQG problem 
will also solve the quantum LQG problem (Problem [3]) if and only if a matrix Z can 
be found satisfying (39) and (40) and there exists a real invertible matrix 5* such that 
SZS T 



e 



K- 



It is also possible to treat Problem [6] using the rank constrained LMI procedure of 
Section |5j To do this, again under the simplifying assumptions M = I and N = I — YX 
(but which, as remarked earlier, can be easily removed if desired), introduce the additional 
variable 6^ and substitute A K , B K % {% = 1,2,3), Ck with, respectively, A K , B K % (i = 
1, 2, 3), Ck (cf. Lemma 7j). Then we redefine N = NQk, x = (xi, . . . , xio) and Z to be a 



real symmetric matrix of dimension 25n x 25n, and replace (33) with the following set of 
constraints: 



Z > 



J v 3 ,l 



J 3:4,1 







diag ri/2 (J) = 



-"0,0 

Zi,z 6 — z X6jl 

Z VlA - Z X2i idiag n/2 (J) 
Z„ 2) i — Z X3 ,i diag n/2 (J) 








2^4,1 — Zi X7 iB — 

— Zrr 4 ,lC — 7i x -\A = 



in/2\ 

z 








X7,X6 



Z« 9 ,l 

Zi> 10) i z^ 4 >V6 

fl2)l '^ i V\,X2 





= 
= 

0. 



J V 5 ,1 *-'X4 

Z„ 6 ,i 
Z„ 7l i 

Z« 8 ,l 

^13,1 *^V2,X3 

Zii„i — z 



Zx g ,x 6 

■ Zi jXl0 

-z, 



"^14, 
J X S , 



Z.t 1 + Z 



Xg,X 10 







= 

: 
= 
: 



(42) 
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Here, Z xl0! x + Z\ jXl0 = accounts for the requirement that Qk = —® K while Z Xs ^ + Z X9tXl0 
accounts for the the constraint N = NQ^- The remaining constraints of Section 5, 



(34) and rank(Z) < n, remain the same. Note that the variable N is now also an 
independent variable, whereas in Section [5] iV was linearly related to N by the relation 
N = NQk 1 for some fixed constant Qk- However, the introduction of additional free 
variables and constraints increase the complexity of the problem and may have a bearing 
on the convergence of the alternating projections algorithm. Therefore, the solver for 
Problem [6] may be used to complement the solver for Problem [3j and substitute for one 
another in case convergence fails for one of them. Furthermore, it is also necessary to 
develop an additional heuristic to determine a good initial guess 9^ for 0#. These can 
be topics to be considered for further research. Possible, albeit arbitrary, choices for 9^ 
are 9^ = 2x2 or 9^ = J. Once 9^ has been chosen, we set N = I - YX, N° = NQ° K 
and 

V = [I A T B K1 BJ <2 B K , C T X T Y T (N°f N T (e° K ) T Wj ... Wf 4 ] T , 

then the alternating projections algorithm can be executed by setting Z = V V^ as the 
starting point. 

Remark 9 It should be noted that the extended procedure should not be considered to 
supersede the procedure for strictly finding a quantum controller. This is because, as 
discussed in the Introduction, there can be circumstances where a quantum controller is 
desirable while the extended procedure may not return such a controller since Ok is allowed 
to be free. 



8 Quantum LQG control design examples 



In this section, we apply the transformation and matrix lifting technique of Section [5] to 
compute a fully quantum LQG controller to asymptotically stabilize a marginally stable 
fully quantum plant. We work in Matlab using the Yalmip prototyping environment 
and a solution was computed using LMIRank. The semidefinite program solver used for 
LMIRank is SeDuMi Version 1.1 Release 3; see pQ. Then for comparison, we also compute 
a classical controller that modulates a light beam to drive the plant. All computations 
were performed on Matlab running on an Apple Mac Pro workstation configured with 
two 3GHz Quad-Core Intel Xeon processors, 8GB of memory and 232.89GB hard disk 
capacity. 

The quantum plant to be controlled is a physically realizable (cf. Section |3| fully 
quantum system with Hamiltonian matrix R and coupling matrix A (see [T7] for the 
corresponding definitions) given by 



R 



A 
A 



A 



«T 
«i 



17 



Then, its dynamics are given by 



dx 
dy 



A 
-A 

2^fk 2 




xdt + 












du + 














-2Vh 



dwi 

dlU2 



xdt + dw\ 



(43) 



with A = 0.1 and k\ = &2 = k% = 10~ 2 . This plant may be thought of as representing the 
scenario of an atom trapped between two mirrors of a three mirror cavity in the strong 
coupling limit in which the cavity dynamics are adiabatically eliminated; see [T2l IS]. Note 
that by definition of the coupling matrix A, the quantum noise fields couple only to the 
position operator of the atom, which is also the typical setup sought in various schemes 
for quantum non-demolition continuous measurement of position. This particular choice 
of coupling results in a marginally stable plant with A having two mutually conjugate 
eigenvalues on the imaginary axis. 



8.1 Quantum LQG controller design example I 

Let us try to asymptotically stabilize this system with another quantum system as the 
LQG controller. To this end we set z = i.e., C z = ^2x2 = D z . Choosing 7 = 5.75 and 
numerically solving Problem [3] following Sections [5] and [6j yields the following physically 
realizable controller after 1000 iterations of LMIRank (with a running time of 2944.9 
seconds) : 



di 



£dt + 



du{t) 



-2.3907 0.8420 
-5.5518 1.9380 

0.0241 -0.0471 
0.0576 -0.1136 

-1.0819 0.5042 
-0.6603 0.3029 



10 



-10 



-0.3029 
-0.6603 

dw K 2 + 



0.5042 
1.0819 

3.3626 
7.6699 



dwxi + 

2.1470 
5.0302 



dy 



xdt + dwxi 



(44) 



that asymptotically stabilizes the closed-loop system. The actual closed loop LQG cost 
achieved by this controller can be computed to be Joo = 5.7382. 

Notice that elements of B^2 are very small (of the order 10~ 10 ). This is a result that 
we would ideally like to have since B^2 is the coefficient for the quantum noise wki that 
only enters in the controller and does not come from the plant. This noise contributes 
towards the LQG cost, but since the aim is to bound this cost, it is not surprising that 
the algorithm finds a controller for which Bk2 is effectively zero, in order to remove the 
effect of the variance of wk2 on the LQG cost. Up to the numerical precision of Matlab, 
the above numerical results give: 



A K e K + e K A T K + B KiJB T Ki 



10 



-13 



k=l 





-0.2896 



0.2896 




(45) 
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while dropping the quadratic term containing Bk2 (he., setting Bk2 = 0) returns an iden- 
tical numerical result on the right hand side of (145]) . This indicates that the contribution 



of E>K2 to (45) is less that the numerical precision of Matlab and we may in this case 
simply set B^2 — to obtain a simpler controller. 



8.2 Classical LQG controller designs 



After successfully obtaining a fully quantum controller, a natural question that now arises 
is: Does this controller offer any improvement over a classical controller that is driven 
by continuous measurements (e.g., by homodyne detection; see [3]) of a quadrature of 
the plant output yl To answer this question, suppose now that we perform continuous 
measurements of one quadrature (in this case, the first element) of y. Thus, we replace 
the output y in (43) by another output y' (a classical signal) given by: 

y ' = [ 2^fk 2 ]xdt +[10 }dwi. 

We seek a classical controller of the form: 



d£ = A K £dt + B K dy'; 
flu = Ck£, 

whose output modulates a light beam to produce the control signal u: 

du = p u dt + dwxi 
= Cx^dt + dwKi- 



(46) 



(47) 



The optimal controller matrices Ak, B%, Ck can now be found by applying the standard 
LQG machinery (with C z and D z as before) to the following modified plant (to account 
for the presence of the noise wki in the controller output u, see a related discussion in 
Section loT) with (5 U being viewed as the "control signal" : 



dx 



A 
-A 




-2jk x 



+ 








xdt + 



-2^/¥ 2 



Pudt 




dwxi 
dwi 
dw 2 



dy 



[ 2y/h ]xdt +[10 }dw 1 . 



The optimal classical controller was then found to be: 

_ f -0.0658 0.1 1 
^ ~ [ -0.1217 -0.2 J * l + 

du = „ , £dt + dwKi, 



0.3291 
0.1083 



dy'; 



1 
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while the optimal LQG cost is = 4.8468. 

It turns out that cost obtained by this classical controller is lower than the cost we 
had previously obtained with the quantum LQG controller (J^ = 4.8468 in the former 
compared to = 5.7382 in the latter). Moreover, this may not the best performance 
achievable by a classical linear controller as it is also possible to perform a so-called 
indirect measurement of y by first mixing it with an additional vacuum noise via a beam 
splitter [31 HO], followed by homodyne detection of the real quadrature of one output 
of the beamsplitter and of the imaginary quadrature of the other output, thus giving 
the controller noisy information about both quadratures of y. For examples of indirect 
measurement, see [TTJ Sections VII- C and VII-D]. 

To describe an indirect measurement process, suppose that the vacuum noise going 
into the beamsplitter is wo = (100,1,^0,2) (in quadrature notation) and the beamsplitter 
divides the signals between the two ports according to the ratio a : (3 where a 2 + [3 2 = 1, 
< a, (3 < 1. Then the classical output signal y" of the indirect measurement is given 
by: 



dy" 



a 








dy + 












a 



dwo- 



Let us now seek a classical controller of the form (46) and (47) with y' replaced by y" 
for various values of a between and 1. Note that measurement of y' can be viewed as a 
special case of indirect measurement with a = 1. A plot of the LQG cost achieved by 
this controller versus the value of a is shown in Figure [TJ 



0.1 0.2 0.3 0.4 0.5 0.6 0.7 o.a 0.9 1 



0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.9! 



Figure 1: Plot of vs. a 

It can be seen that achieves its minimum around a = 0.715 with a value of 
Joo ~ 4.4440. This raises the question of whether there exists at all a fully quantum 
controller that gives a cost lower the best achievable with indirect measurements. We 
shall see in the next section that the answer to this is affirmative by obtaining such a fully 
quantum controller. 
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8.3 Quantum LQG controller design example II 



We now try to find a fully quantum controller that achieves a cost Joo < 4.444. However, 
several attempts at numerically solving Problem [3] for = J by alternating projections 
were unsuccessful with the algorithm failing to converge. Thus, we turn our attention to 
numerically solving Problem [6] according to the discussion in Section [7] with 7 = 5 and 
®k = 02x2- It turns out that the alternating projections algorithm converges (with a 



running time of approximately 781.87 seconds) and returns the following solution: 







K 



B 



Kl 



B 



A3 



-0.1820 
0.1820 

0.0642 -0.0547 
0.0480 -0.2556 

0.3522 -0.0215 
0.4393 -0.0842 



and with the LQG cost = 4.1793. 



.4 



A" 



B 



C 



K 



-0.2125 
-0.3789 



A" 2 



0.0666 
0.0257 

-0.0468 
-0.1160 

1.4044 0.3008 
0.2639 0.3526 



10 



-10 



0.0255 
0.0114 



Remark 10 It is important to note here that although the type of controller is not a priori 
specified, the algorithm returns ®k which corresponds (up to a similarity transformation) 
to a fully quantum controller, rather than a classical controller. 



Since 9^ = SJS T with S = v / 0182 



1 

1 



then according to Lemma 



matrices A K , B Ki (i 
A K = 

C k - 



1,2,3) and Ck solving Problem [3] as follows: 



we find the 



0.0257 -0.3789 
0.0666 -0.2125 

-0.2721 0.0272 
-0.1096 0.0601 

0.1283 -0.5992 
0.1504 -0.1126 



0.1126 
0.1504 



10 



-10 



B 



A3 



-0.5992 
-0.1283 

1.0297 
0.8255 



-0.1974 
-0.0503 



(48) 



Note again that Br 2 has negligibly small entries and in a similar fashion to the re- 
lated discussion in Section 8.1, we may set Bk2 = to obtain a simpler controller. 



For this controller we have that the right hand side of (|45|) takes the numerical value 




10 



-13 



The fact that we were ultimately able to find a fully quan- 



0.6098 
-0.6098 

turn controller that outperforms the best performance of a classical linear controller with 
indirect measurement (with = 4.1793 in the former compared to ~ 4.4440 in the 
latter case) is very interesting and indicates that the quantum LQG controller should be 
considered to be more than a theoretical curiosity, but one which may potentially be of 
practical significance. 
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It is important to note that although the controller (48) beats the class of classical 
linear controllers with indirect measurements, it may not beat all possible classical con- 
trollers. For example, there may exist classical non-linear controllers that could perform 
just as well or better. 

Remark 11 Here we do not discuss the physical realizations of fully quantum controllers 



such as (44) an d (48) ^ n the laboratory using currently available quantum optical compo- 
nents. This is addressed in the work of [27\J on a network synthesis theory for dynamical 
quantum optical networks that parallels that of electrical network synthesis theory. 



9 Conclusions 

In this paper, we have formulated a quantum LQG problem that allows the possibility for 
the controller to be another quantum system. In general, this problem is a polynomial 
matrix programming problem that can be systematically converted to a rank constrained 
LMI problem. To solve the problem, we propose a numerical procedure based on an 
alternating projections algorithm and an extension of this procedure for the case where 
the type of controller is not a priori specified. In two examples, we consider the problem 
of stabilization of a marginally stable quantum plant and successfully compute some fully 
quantum LQG controllers that achieve this goal. We show that for the fully classical 
controller schemes considered herein (in which continuous measurements are performed 
on the output of the plant), a fully quantum LQG controller can be found which gives an 
improved level of performance. 

It is important to emphasize that the quantum LQG problem posed here cannot be 
solved by simply applying the standard LQG methodology, since the resulting controller 
may not be physically realizable (i.e., the controller system matrices are not guaranteed to 



satisfy (18) and (19)). In fact, unlike the classical LQG problem that can be reformulated 
as a convex LMI problem, the quantum LQG problem is in general computationally hard. 

For future investigation, theoretical aspects of the quantum LQG problem posed herein 
deserve further study. At the moment, system theoretic conditions for the existence of a 
solution to this problem are not known. Another avenue which is of importance for future 
investigation is the practical implementation of quantum LQG controllers and, indeed, 
general linear quantum controllers in the laboratory. 

Acknowledgement 12 The first author thanks R. Or si for discussions on rank con- 
strained LMI problems and the LMIRank software, V. P. Belavkin for discussions on 
quantum linear systems and dynamic programming, and J. Lofberg for correspondences 
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